Browse: 🏠 · Solutions · Connectors · Methods · Tables · Content · Parsers · ASIM Parsers · ASIM Products · 📊
Reference for HDInsightSparkStageEvents table in Azure Monitor Logs.
| Attribute | Value |
|---|---|
| Category | Azure Resources |
| Basic Logs Eligible | ✗ No (source) |
| Supports Transformations | ✓ Yes (source) |
| Ingestion API Supported | ✗ No |
| Azure Monitor Tables Reference | View Documentation |
Source: Azure Monitor documentation
| Column Name | Type | Description |
|---|---|---|
| _BilledSize | real | The record size in bytes |
| _IsBillable | string | Specifies whether ingesting the data is billable. When _IsBillable isfalseingestion isn't billed to your Azure account |
| _ResourceId | string | A unique identifier for the resource that the record is associated with |
| _SubscriptionId | string | A unique identifier for the subscription that the record is associated with |
| ApplicationId | string | The application ID of the application producing the record. |
| AttemptId | string | The Id of the stage attempt. |
| ClusterDnsName | string | The DNS name of the cluster running the stage. |
| ClusterTenantId | string | The tenant ID of the cluster running the stage. |
| CompletionTime | datetime | The time (UTC) the stage was completed. |
| Details | string | The exception details for any stage failures. |
| FailureReason | string | The reason for failure if the stage failed. |
| Host | string | The FQDN of the host. |
| IpAddress | string | The IP Address of the node running the stage. |
| RDDInfo | string | Json containing information about RDDs used in the stage. |
| Region | string | The region of the cluster running the stage. |
| Role | string | The type of node running the stage. |
| SourceSystem | string | The type of agent the event was collected by. For example,OpsManagerfor Windows agent, either direct connect or Operations Manager,Linuxfor all Linux agents, orAzurefor Azure Diagnostics |
| StageId | string | The ID of the stage. |
| StageName | string | The name of the stage. |
| SubmissionTime | datetime | The time (UTC) the stage was submitted. |
| TaskCount | int | The count of tasks associated with the stage. |
| TenantId | string | The Log Analytics workspace ID |
| TimeGenerated | datetime | The timestamp (UTC) of when the log was generated. |
| Type | string | The name of the table |
| UserSubscriptionId | string | The subscription ID of the cluster running the stage. |
This table collects data from the following Azure resource types:
microsoft.hdinsight/clustersBrowse: 🏠 · Solutions · Connectors · Methods · Tables · Content · Parsers · ASIM Parsers · ASIM Products · 📊